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Description 

This invention relates to video image processing apparatus. 

Wlien an analogue video image is converted to a binary value, the number of picture elements (pixels) which form 
s the analogue video image are increased, for example, to twice the number of pixels in the vertical and horizontal 
directions, so that each pixel is now expressed by four small pixels. As a result, five gradations are possible for each 
set of four small pixels, that is, the four small pixels are either all white, one pixel is black, two pixels are black, three 
pixels are black, or ail four pixels are black. The pixels of the analogue video image are compared with four threshold 
values and converted to respective expressions of the five gradations in response to the compared outputs. 
10 If conversion or quantization is simply performed as described above, the gradation of the video image changes 

in a step-wise manner thereby producing a so-called quasi-contour, and resulting in considerable degradation of the 
quality of the video image. 

As a result, a prior proposal has been made to remove the quasi-contour by mixing the analogue video image with 
a desired noise component having no correlation to the analogue video image. However, this method results in a lower 
signal-to-noise (S/N) ratio of the video image, so that a good image quality is not obtained. 

Moreover, when a so-called computer hologram is formed, it is supplied in binary form although it is formed from 
an analogue value. As a result, quantization noise occurs which causes the S/N ratio of a reproduced picture to be 
considerably deteriorated. 

1989 International Conference on Acoustics. Speech and Signal Processing. 23 May 1989, page 1787-1790; D 
^0 Anastassiou et al "Image halftoning and reconstruction using a neural network' diseases a system utilizing a neural 
network to minimize a frequency- weighted mean square error criterion to perform grayscale to halftone conversion. 

According to the present invention there is provided a video image processing apparatus for converting an analogue 
video image into a binary video image, the apparatus comprising: 

25 input means for receiving said analogue video image; 

samplirig means for sampling the received analogue video image; 

a neural network circuit having a plurality of neurons which are connected together through respective synapses; 
setting means for setting a predetermined function; 

first computing means for computing respective threshold values for each of said neurons in said neural network 
30 circuit on the basis of the sampled value of the video image and said predetermined function; and second computing 

means for computing respective coupling coefficients for each of said synapses of said neural network circuit on 
the basis of said predetermined functbn; 

said neural network circuit processing said threshold values and said coupling coefficients so as to fomi said binary 
video image; 

35 characterized in that the input analogue video image is a computer hologram and said predetermined function is 

a window function indicative of a range of a desired image of a reproduced video image which results from Fourier- 
transforming said computer hobgram. 

Viewed from another aspect the invention provides a video image processing apparatus for converting an analogue 
40 video image into a binary video image, the apparatus comprising: 

input means for receiving said analogue video image; 

sampling means for sampling the received analogue video image; 

a neural network circuit having a plurality of neurons which are connected together through respective synapses; 

4S setting means for setting a predetermined function; 

first computing means for computing respective threshold values for each of said neurons in said neural network 
circuit on the basis of the sampled value of the video image and said predetermined function; and second computing 
means for computing respective coupling coefficients for each of said synapses of said neural network circuit on 
the basis of said predetermined function; 

so said neural network circuit processing said threshold values and said coupling coefficients so as to form said binary 

video image; 

characterized in that the input analogue video image is a computer hologram and said predetermined function has 
a frequency characteristic which corresponds to that of a human's eyes. 

55 The invention will now be described by way of example with reference to the accompanying drawings, throughout 

which like parts are referred to by like references, and in which: 

Figure 1 is a block diagram of an embodiment of video image processing apparatus according to the present 
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invention; 

Figure 2A is a schematic diagram showing an example of a Hopfield type neural network circuit; 
Figure 2B is a schematic diagram showing an arrangement of neurons; 
Figure 3 is a diagram for explaining a neural network circuit; 
5 Figure 4 is a diagram showing an example of a binary video image derived by a prior method; 

Figure 5 Is a diagram showing an example of a binary video Image derived by a video image processing apparatus 
according to the present invention; 

Figure 6A is a diagram showing a prior example of a reproduced picture of a computer hologram; and 

Figure 6B is a diagram showing an example of a reproduced picture of a computer hologram using an embodiment 

10 of the present invention. 

Referring to Figure 1 , an analogue video Image signal Is supplied through an analogue video image Input device 
1 to a sampling device 2, in which It is sampled horizontally and vertically In a manner similar to that used in television 
scanning, to extract values of respective pixels. 
IS A neural network circuit 3, for example, a Hopfield type neural network circuit which will be more fully described 

below, is preferably provided with four times as many neurons as the number of sampled pixels, corresponding to the 
small pixels in the previously described prior conversion. 

Also shown in Figure 1 Is a function setting device 4 in which a predetermined function Is set which, for example, 
has a binary frequency which corresponds to a frequency characteristic of a human's eyes. The function set in the 
20 function setting device 4 and the values of respective pixels sampled by the sampling device 2 are supplied to a 
computing device 5 which computes threshold values for respective neurons of the neural network circuit 3. The function 
set in the function setting device 4 is also supplied to a computing device 6 which computes coupling coefficients for 
synapses of the neural network circuit 3. 

Processing is performed in the neural network circuit 3, and converged values formed in the respective neurons 
25 are supplied to an output device 7 as an output binary video image signal. 

Alternatively, the value of each pixel sampled by the sampling device 2 may be compared with a desired threshold 
value whereupon the compared output may be supplied to each neuron of the neural network circuit 3 as an initial value. 

As a result, the input analogue video image from the input device 1 is converted to a binary value. 

More specifically, assume that a human's image focusing system is incoherent. A resultant image g^^^ is provided 
30 by multiplying an original video image g^f^^ by a filter having a characteristic W^q of a human's eyes, this being basically 
a low-pass fitter characteristic. 

Substituting the Fourier-transform of W^q, which is represented as w^^^, yields the following equation (1): 

9(m) = 9(J*W^„j (1) 

^ where * represents the convolution. 

On the other hand, assume that pi^f^) represents a binary video Image and a^^rn) represents the binary video image 
as focused on the retina of a human's eyes, In which a represents a coefficient selected by the video image. may 
be expressed as: 

40 ^(m) = ^^(m) *^m) (2) 

An embodiment of the present invention converts an analogue video Image Into a binary value, so that the differ- 
ence, as formed on the retina of a human's eyes, between the binary video image and the original video Image Is 

minimized. 

An error energy E may be defined as: 



45 



so 



Substituting equation (2) into the equation (3) yields: 
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Further, assume that: 

IS i 

Substituting the above expression in equation (4) yields the following equation (5): 

• . i j 

• 2a E E ftj.j pj,, W(,.,, ...S 
■ J 

Further assuming that: 



-2 E wt..i, w^..^, if : i 1^ j 



if : 1 n j 



40 '^B) - "2 E ft^ij ^'(l-a) 

then, substituting the above expressions into equation (5) produces the following expression for the error energy E: 
E = (-}) a* E E Uii) P(i, j> * a E ^^j, u^y ♦ C ...(6) 

45 i J 1 

The Hopfietd type neural network circuit 3 may, for example, be constructed as shown in Figure 2A, in which a neuron 
is formed as a comparator, and synapses are formed as resistors (see US patent specification US-A-4 660 166 and 
US-A-4 719 591). In this situation if S^,-^ is a threshold value of a neuron, V^j^ is an output of the neural network circuit, 
and T(j 0 is a coupling coefficient between respective neurons. The output V^;) may be expressed as: 



♦ 1 if : E T(,. j7 Vjj, 1 Sj,> 
\ J 

V, 



"(1) 



- 1 if : E T<,, i7 V^,, < S^, 



J 

This circuit may be schematically represented as in Figure 2B. If, however, five neurons are provided, then the neural 
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network circuit is constructed as shown in Figure 3. 

If the coupling coefficient of synapses which return to the same neuron is 0 and the coupling coefficients between 
the neurons are equal to each other, then the neural network circuit shown in Figure 3 operates so as to minimize the 
error energy E which, in turn, nnay be expressed as: 

E - (-J) E S T^i^ M^j, ♦ Z M^,y S^, ...(7) 
i i 

Accordingly, as is to be appreciated from equations 6 and 7, if in the above-described apparatus the threshold 
values S(j^ of respective neurons in the neural network circuit 3 are computed by the computing device 5 on the basis 
10 of the value g^^) sampled by the sampling device 2 and the function w^^j set in the setting device 4, and the coupling 
coefficients T^i,0 of respective synapses of the neural network circuit 3 are computed by the computing device 6, the 
analogue video image is converted into a binary value which has a relatively minimal error as obsen/ed on the retina 
of a human's eyes. 

In a preferred embodiment of the above described apparatus, the calculations required in the neural network circuit 
'5 3 are performed by a computer 

Figures 4 and 5 show actual examples of binary value video images in which an original picture having 480 x 480 
pixels is converted into a binary video image having 960 x 960 pixels. More specifically, Figure 4 shows an example 
of a binary video image produced in accordance with a prior method, whereas Figure 5 shows a binary video image 
of excellent quality formed by the apparatus of the present invention. 
20 The tormatbn of a computer hotogram will now be described. 

In formulating a computer hologram, video image information is Fourier-transformed and the Fourier-transformed 
analogue value is converted into a corresponding binary value, which is then recorded as a hologram. Accordingly, the 
video image Fourier-transformed represents a hologram spectrum. Therefore the computer hologram converts an 
anabgue waveform Fourier-transformed into a binary value in which the hologram spectrum represents a desired 
2S portion. However in the prior art, it is frequently obsen/ed that, if an analogue video image is converted into a binary 
value by a simple slice level, quantization noise occurs whfch causes the S/N ratio to be deteriorated. 

Therefore, assume that G^^^ represents a signal on a spectrum surface, that is, a reproduced video image. Further, 
assume that an area from which noise is to be removed on the spectrum surface can be expressed by a window functbn 
W^i^j which may, for example, be expressed as: 

30 . . 



3$ 




1 if noise is to be removed from the area 
0 if noise is permitted in the area 



Further, assume that noise is to be removed from a portion in which the signal G^i^^ is defined. That is: 

g^^) represents the Fourier-transform of the signal G^i^^, and since g^^j is typically a complex number, it cannot be 
^ recorded directly. Therefore, instead of g^^). 

{+1.-1} 

is recorded. As a result, a signal appearing on the spectrum surface becomes B^i^), instead of the ideal signal G^y^y in 
which B(k) is the Fourier-transform of b^^j. 
^ In the present case the intention is to make b^^^ such that the difference between B^^j and G^p^j is minimized. 

Accordingly, the error energy E is defined as follows: 

E = E I W,„ {G(„ - a B,„} V ...(b) 

k 

According to Parseval's theorem, the above-mentioned definition yields: 

B - E I • a • bj., I' ...(c) 
■ 

in this case, it is assumed that G^^ and W^i^^ satisfy a conjugate symmetric relationship relative to the original point. 
^ That is. 
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At that time, Fourier-transforms g^^j and w^^) become real numbers. 
Arranging the energy function E by the use of this relationship yields: 

E = (-J) Z Z b(j, P(t. J) bjjj ♦ a E b^^, ♦ C ...(d) 

5 1 J t 

where: 

f-2 Z w^i.., if : i j 

0 if : i = J 



■ 

Accordingly, on the basis of equation (d) and equation (7) of the Hopfield type neural network circuit, g^j^ assumes 
a threshold value of each neuron, assumes a coupling coefficient of each synapse and b^j) assumes an output of 
20 each neuron. As such, it is possible to minimize the error energy E by using the neural network circuit. 

Figures 6Aand 6B illustrate actual examples of reproduced video Images of computer hologram. More specifically. 
Figure 6A shows a prior reproduced video image in which the S/N ratio is considerably deteriorated, whereas as shown 
in Figure 6B, an excellent reproduced video image can be produced using an embodiment of video image processing 
apparatus according to the present invention, in which noise is reduced in the desired portion of the vkleo image. 
2S As described above, with an embodiment of video image processing apparatus according to the present invention, 

a vkleo image is processed by the use of the neural network circuit, whereby the analogue video image can be satis- 
factorily converted into a binary value and a computer hologram can be satisfactorily fomied. 

With the above-described video image processing apparatus, the threshold values of the respective neurons and 
the coupling coefficients of the respective synapses in the neural network circuit are computed on the basis of the 
30 incoming analogue video image and a predetermined function as previously described. 

The difference component E between the incoming analogue video image and the binary video image is defined as: 

E « (-i) a* E E p^i, P<4^ J, pjj, ♦ a 2^ ? i) ♦ C 

35 ' ^ ' 

where a represents the coefficient, represents the value which results from converting the incoming analogue video 
image into the binary value, P^j represents the value which is obtained from the function, and g^j^ is the value which 
is obtained from the function and the input analogue video image. As a result, it is possible to convert the input analogue 
video image into the binary value by using the neural network circuit. 

40 Further, by setting the function to have the frequency characteristic as a human's eyes, it is then possible to obtain 

a binary video image which is visually excellent for a human's eyes. 

Further, if the incoming analogue video image is a computer hologram and the function is a window function which 
indicates the range of the desired image of the reproduced video image which in turn results from Fourier-transforming 
the computer hologram, the noise in the range of the desired image in the reproduced video image can be reduced 

4S and an excellent reproduced video image can be obtained. 



Claims 

^ 1. A video image processing apparatus for converting an analogue video image into a binary video image, the ap- 
paratus comprising: 

input means (1) for receiving said analogue video image; 
sampling means (2) for sampling the received analogue video image; 
ss a neural network circuit (3) having a plurality of neurons which are connected together through respective 

synapses; 

setting means (4) for setting a predetermined function; 

first computing means (5) for computing respective threshold values for each of said neurons in said neural 
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network circuit (3) on the basis of the sampled value of the video image and said predetermined function; and 
second computing means (6) for computing respective coupling coefficients for each of said synapses of said 
neural network circuit (3) on the basis of said predetermined function; 

said neural network circuit (3) processing sakJ threshokj values and said coupling coefficients so as to form 
s said binary video image; 

characterized in that the input analogue video image is a computer hologram and said predetermined function 
is a window function indicative of a range of a desired image of a reproduced video image which results from 
Fourier-transforming said computer hologram. 

10 2. A video image processing apparatus for converting an analogue video image into a binary video image, the ap- 
paratus comprising: 

input means (1) for receiving said analogue video image; 
sampling means (2) for sampling the received analogue video image; 
IS a neural network circuit (3) having a plurality of neurons which are connected together through respective 

synapses; 

setting means (4) for setting a predetermined function; 

first computing means (5) for computing respective threshold values for each of said neurons in said neural 
network circuit (3) on the basis of the sampled value of the video image and said predetermined function; and 
20 second computing means (6) for computing respective coupling coefficients for each of said synapses of said 

neural network circuit (3) on the basis of said predetermined function; 

said neural network circuit (3) processing said threshold values and said coupling coefficients so as to form 
said binary video image; characterized in that the input analogue video image is a computer hologram and 
said predetermined function has a frequency characteristic which corresponds to that of a human's eyes. 

2S 

3. Apparatus according to any one of claims 1 or 2 wherein a difference component between the input analogue 
video image and said binary video image is a function of the value obtained from said predetermined function, and 
the value obtained from said input analogue video image and said predetermined function. 

30 

Patentanspruche 

1. Vkieobildverarbeitungsanordnung zum Umsetzen eines analogen Videobildes in ein binares Videobild. 

35 mit einer Eingangseinrichtung (1) fOr die Aufnahme des genannten analogen Videobildes, 

mit einer Abtasteinrichtung (2) zum Abtasten des aufgenommenen analogen Videobildes, 
mit einer neuronalen Netzwerkschaltung (3), umfassend eine Vielzahl von Neuronen, die Ober entsprechende 
Synapsen miteinander veri^unden sind, 

mit einer Einstelleinrichtung (4) zum Einstellen einer bestimmten Funktion. 
40 mit einer ersten Recheneinrichtung (5) zum Berechnen entsprechender Schwellwerte fur jedes der Neuronen 

in der genannten neuronalen Netzwerkschaltung (3) auf der Basis des abgetasteten Wertes des Videobildes 
und der genannten bestimmten Funktion, 

und mit einer zweiten Recheneinrichtung (6) zum Berechnen entsprechender Kopplungskoeffizienten fur jede 
der Synapsen der genannten neuronalen Netzwerkschaltung (3) auf der Basis der genannten bestimmten 
45 Funktion, 

wobei die genannte neuronale Netzwerkschaltung (3) die genannten Schwellwerte und die genannten Kopp- 
lungskoeffizienten derart verarbeitet, da3 das genannte binare Videobild gebildet ist, 

dadurch gekennzeichnet, 

so 

daQ das eingangsseitige analoge Videobild ein Computer-Hologramm ist 

und da3 die genannte bestlmmte Funktion eine Fensterfunktion ist, die kennzeichnend ist fur einen Bereich 

eines gewunschten Bildes eines wiedergegebenen Videobildes, 

welches aus der Fourier-Transformation des genannten Computer-Hologramms resultiert. 

55 

2. Videobildverarbeitungsanordnung zum Umsetzen eines analogen VkJeobikles in ein binares Vkjeobild, 

mit einer Eingangseinrichtung (1 ) fur die Aufnahme des genannten anabgen Videobildes, 
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mit einer Abtasteinrichtung (2) zum Abtasten des aufgenommenen analogen Videobildes, 

mit einer neuronalen Netzwerkschattung (3), umfassend eine Vielzahl von Neuronen, die uber entsprechende 

Synapsen miteinander verbunden sind, 

mit einer Einstelleinrichtung (4) zum Einstellen einer bestimmten Funktion, 

mit einer ersten Recheneinrichtung (5) zum Berechnen entsprechender Schwellwerte fur jedes der genannlen 
Neuronen in der neuronalen Netzwerk-schattung (3) auf der Basis des abgetasteten Wertes des Videobildes 
und der genannten bestimmten Funktion, 

und mit einer zweiten Recheneinriclitung (6) zum Berechnen entsprecliender KopptungskoefTizienten fur jede 
der Synapsen der genannten neuronalen Netzwerksclialtung (3) auf der Basis der genannten bestimmten 

Funktion, 

wobei die genannte neuronale Netzwerkschaltung (3) die genannten Schwellwerte und die Kopplungskoeffi- 
zienten derart verarbeitet, da3 das genannte binare Videobild gebildet ist, 

dadurch gekennzelchnet, 

da3 das eingangsseitige analoge Videobild ein Computer-Hologramm ist 

und daR die genannte bestimmte Funktion einen Frequenzverlauf aufweist, der dem menschlicher Augen 
entspricht. 

3. Anordnung nach Anspruch 1 Oder 2. wobei eine Differenzkomponente zwischen dem eingangsseitlgen analogen 
Videobild und dem genannten binaren Vjdeobild eine Funktion des von der genannten bestimmten Funktion er- 
haltenen Wertes und des von dem eingangsseitlgen analogen Videobild und der genannten bestimmten Funktion 
erhaltenen Wertes ist. 



Revendlcations 

1. Dispositif de traitement d'image vidSo pour convertir une image vid^o analogk^ue en une image video binaire, 
dispositif comportant : 

des moyens d'entr^e (1 ) pour recevoir ladite image vid^o anabgique; 

des moyens d'^chantillonnage (2) pour 6chantillonner I'image vidto analogique regue; 

un r^seau neural (3) poss^dant une plurality de neurones qui sont relics tes uns aux autres par rinterm^dialre 

de synapses respectives; 

des moyens de r^glage (4) pour r6gler une fonction pr6d6termin6e; 

des premiers moyens decalcul (5) pourcalcuter des valeursde seuil respectives pour chacun desdits neurones 
dans ledit rdseau neural (3) en fonction de la valeur 6chantillonn6e de I'image vid6o et de ladite fonctbn 
pr6ddtermin6e; et 

des seconds moyens de calcul (6) pour calculer les coefficients de couplage respectifs pour chacune desdites 
synapses dudit rSseau neural (3) en fonction de ladite fonction pr^d^terminee; 

ledit reseau neural (3) traitant lesdites valeurs de seuil et lesdits coefficients de couplage de maniere ^ former 
ladite image video binaire; caract6ris6 en ce que I'image video analogtque d'entr6e est un hologramme de 
calculateur et ladite fonction pr^ddterminde est une fendtre de fonction representative d'une plage d'une image 
souhaitSe d'une image vidto reproduite qui rdsulte de la rriodification dudit hologramme de calculateur par 
transformation de Fourier. 

2. Dispositif de traitement d'image vid6o pour convertir une image viddo analogique en une image vid^o binaire, 
dispositif comportant : 

des moyens d'entrde (1 ) pour recevoir ladite image vid^o analogique; 

des nrtoyens d'6chantillonnage (2) pour 6chantillonner I'image vid^o analogique re^ue; 

un rdseau neural (3) possddant une plurality de neurones qui sont relics les uns aux autres par des synapses 

respectives; 

des moyens de r6glage (4) pour r6gler une fonction pred6termin6e; 

des premiers moyens de calcul (5) pour calculer tes valeurs de seuil respectives pour chacun desdits neurones 
dans ledit reseau neural (3) en fonction de la valeur tehantillonn^e de I'image vidto et de ladite fonctk>n 
prdd6termin6e; et 

des seconds moyens de calcul (6) pour calculer des coefficients de couplage respectifs pour chacune desdites 
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synapses dudit rdseau neural (3) en fonction de ladite fonction prdddtermin^e; 

ledit reseau neural (3) traitant lesdites valeurs de seuil et lesdits coefficients de couplage afin de former ladite 
image video binaire; caracterisS en ce que Timage vid6o analogique d'entrSe est un hologramme de calculateur 
et ladite fonction predeterminSe possede une caracteristique de frequence qui correspond d celle de I'oeil 

humain. 



Dispositif selon Tune quelconque des revendications 1 ou 2, dans lequei une composante de difference entre 
{'image vid^o analogique d'entr^e et ladite image vid^o binaire est une fonction de la valeur obtenue d partir de 
ladite fonction pr^ddtermlnde, et la valeur obtenue d partir de ladite image vidto analogique d'entr^e et de ladite 
fonction pr6d6term!n6e. 
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FIG. 3 
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FIG. 5 
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